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(57) ABSTRACT 

An adaptive control system is disclosed. The control system 
can control uncertain dynamic systems. The control system 
can employ one or more derivative-free adaptive control 
arcliitectures. The control system can further employ one or 
more derivative-free weight update laws. The derivative-free 
weight update laws can comprise a time-varying estimate of 
an ideal vector of weights. The control system of the present 
invention can therefore quickly stabilize systems that 
undergo sudden changes in dynamics, caused by, for 
example, sudden changes in weight. Embodiments of the 
present invention can also provide a less complex control 
system than existing adaptive control systems. The control 
system can control aircraft and other dynamic systems, such 
as, for example, those with non-minimum phase dynamics. 
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SYSTEMS AND METHODS EOR 
DERIVATIVE-EREE ADAPTIVE CONTROL 

CROSS-REFERENCE TO RELATED 
APPLICATIONS AND PRIORITY CLAIM 

This application claims priority under 35 U.S.C. §1 19(e) 
to, and the benefit of, U.S. Provisional Patent Application No. 
61/474,529, entitled “Derivative-Free Output Feedback 
Adaptive Control,” filed 12 Apr. 2011. The entirety of the 
above-mentioned Application is hereby incorporate by refer- 
ence as if set forth in its entirety below. 

STATEMENT REGARDING FEDER.A.LLY 
SPONSORED RESEARCH 

The present invention was made with United States Gov- 
ernment support under contract number NNX08AC61A 
awarded by NASA. The United States Government has cer- 
tain rights in the present invention. 

BACKGROUND OF THE IN\^ENTION 

1. Field of the Invention 

Embodiments of the present invention relate to control 
systems, and particularly, to adaptive control architectures for 
uncertain dynamic systems. 

2. Background of Related Art 

An adaptive controller is a controller that makes adjust- 
ments, i.e., adaptations, to control an uncertain system. 
Uncertain systems are systems that can have fixed or time 
varying parameters with values that are only approximately 
known. Examples of these parameters include, but are not 
limited to, aerodynamic coefficients of aircraft, mode shapes 
of vibrating structures, and parameters associated with 
dynamics of turbine engines, combustion processes, and 
chemical reactions. The variations in the parameters may be 
due to changes in the operation of a system or process, or may 
be due to other factors, such as, for example, releasing a 
payload, docking in space, or unknown failures in subsystem 
components. 

Existing adaptive controllers are used to control several 
types of systems, or “plants,” as they are known in the art. 
They are frequently used, for example and not limitation, to 
control automobile and aircraft engines and in aircraft flight 
controls. 

Many types of adaptive controllers are known. Some adap- 
tive controllers, for example, attempt to control uncertain 
systems by employing a state observer. The state observer 
provides an estimate of the system’ s internal state using mea- 
surements, or sensed quantities, of the uncertain system. The 
adaptive controller can then adapt to these sensed quantities 
and provide an output that stabilizes the uncertain system. 

Generally, research in adaptive control is motivated by the 
desire to maintain a specified level of performance in the 
presence of modeling errors. Performance is usually mea- 
sured by the reaction speed of a response to an externally 
generated command, and the ability of the response to accu- 
rately track the externally generated command as measured 
by the difference between the response and the corresponding 
commanded value. Modeling errors are usually caused by 
uncertainties associated with dynamic responses of the sys- 
tems being controlled. 

Adaptive controllers can be classified as either state feed- 
back or output feedback. State feedback controllers, for 
example, can have computationally simpler adaptive control 
algorithms compared to output feedback algorithms. This can 
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be because, for example, state feedback controllers do not 
require the use of a state observer. Output feedback adaptive 
controllers, however, are required for applications in which it 
is impractical or impossible to sense the entire state of the 
5 process or system under control. Examples of such processes 
or systems include, but are not limited to, active noise sup- 
pression, active control of flexible space structures, fluid flow 
control systems, combustion control processes, control of 
chemical processes, automotive control systems, flight con- 
ic trol of large flexible aircraft and launch vehicles, and low cost 
or expendable unmanned aerial vehicles. Models for these 
applications vary from reasonably accurate low frequency 
models, e.g., in the case of structural control problems, to less 
accurate low order models, e.g., in the case of active control of 
15 noise, vibrations, flows, and combustion processes. 

There have been a number of proposed approaches for the 
design of output feedback adaptive controllers. All of these 
approaches contain inherent limitations. Some approaches 
rely on liigh gain observers, for example, to reconstruct the 
20 states of the controlled process that are not available for 
feedback. High gain approaches, however, are often imprac- 
tical due to, for example, the amplification of sensor noise and 
the potential for unstable responses due to unmodeled high 
frequency dynamics. Other approaches use an output feed- 
25 back adaptive controller with an error observer instead of a 
state observer. These approaches are undesirable, however, 
because they require unnecessarily complex designs and rely 
on high gains, which can lead to unstable responses. 

Incorporating an adaptive controller for uncertain dynamic 
30 systems can mean the replacement of an existing control 
system. It is highly desirable, however, for an adaptive 
approach to simply augment an existing controller. Recently, 
one approach has introduced an adaptive output feedback 
design that relies on the properties of so-called LQG/LTR 
35 controllers that asymptotically satisfy a strictly positive real 
condition. See E. Lavretsky, “Adaptive Output Feedback 
Design Using Asymptotic Properties of LQG/LTR control- 
lers,” AIAA Guidance, Navigation, and Control Conference, 
Toronto, Canada (2010). 

40 This approach minimizes the complexity of the control 
architecture, but cannot be used to augment an existing con- 
troller design and cannot be applied to systems containing 
non-minimum phase dynamics. This is because, for example, 
the stability analysis associated with this approach relies on 
45 the fact that the designer can set gains at arbitrary high values . 
Moreover, like other approaches to output feedback adaptive 
control, it assumes constant unknown ideal weights. This 
assumption can cause a less-accurate response when uncer- 
tain parameters undergo rapid time variations, during sudden 
50 changes in system dynamics, and/or when the system is sub- 
jected to a time varying external disturbance. It is therefore 
undesirable in many scenarios. 

Another deficiency of existing approaches to adaptive con- 
trol is that their weight adaptation laws often employ numeri- 
55 cal integration. While the integration can reduce steady state 
tracking errors, it can also cause a conflict that itself leads to 
a slowly varying tracking error. The slowly varying tracking 
error can arise when adaptive controllers that employ integra- 
tion are used to augment a non-adaptive controller that also 
60 employs integration. Thus, to avoid this behavior, it is desir- 
able to use an adaptive controller with a weight update law 
that does not employ numerical integration. 

It would therefore be desirable to have an adaptive control- 
ler that does not assume constant unknown ideal weights and 
65 instead considers varying ideal weights. Such a controller 
would be desirable, for example and not limitation, in situa- 
tions where uncertainties and disturbances undergo varia- 
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tions on the same time scale as that of the system being 
controlled. The controller should be able to augment an exist- 
ing non-adaptive control design without modifying the gains 
of that design, and should be less complex than existing 
adaptive controllers. The controller should additionally be 
able to control both minimum phase and non-minimum phase 
systems and should not require the use of high gains. The 
controller should also afford freedom in the selection of basis 
functions used to parameterize the uncertainty within the 
plant dynamics. The controller should also avoid weight 
update laws that require numerical integration. It is to such a 
controller that embodiments of the present invention are pri- 
marily directed. 

SUMMARY OF THE INVENTION 

Embodiments of the present invention relate to control 
systems, and particularly, to adaptive control architectures for 
uncertain dynamic systems. In some embodiments, a control- 
ler can employ derivative-free output feedback adaptive con- 
trol architectures. In other embodiments, the controller can 
employ derivative-free state feedback adaptive control archi- 
tectures. The controller can further employ one or more time- 
varying weight update laws. The assumption of constant 
unknown ideal weights commonly used in the design of adap- 
tive controllers, however, can be avoided to provide a more 
accurate response during sudden changes in system dynam- 
ics. Accordingly, while many types of systems can be con- 
trolled, embodiments of the present invention are advanta- 
geous for systems that can undergo sudden changes in 
dynamics, such as those caused by, for example and not 
limitation, reconfiguration, deployment of a payload, dock- 
ing, and structural damage. 

Embodiments of the present invention offer several advan- 
tages not provided by existing systems. In some embodi- 
ments, for example, the present invention can minimize the 
complexity of an adaptive control system compared to many 
existing adaptive control systems. Complexity can be mini- 
mized, for example and not limitation, by employing the state 
observer of an existing, non-adaptive control design without 
any modification to its gains. Moreover, in some embodi- 
ments, the only dynamic element added to the existing design 
is the weight update law, which further minimizes complex- 
ity. Embodiments of the present invention can also control 
both minimum phase and non-minimum phase systems. This 
is advantageous because, for example, non-minimum phase 
systems commonly arise when dealing with aircraft longitu- 
dinal dynamics, which can be difficult to control. In some 
embodiments, the present invention can be used to augment 
an existing non-adaptive control design without modification 
of the gains employed in that design. 

Embodiments of the present invention can employ a 
derivative-free weight update law that is particularly well- 
suited for adaptation to time-varying systems. The derivative- 
free weight update law can also be suited for adaptation to 
discontinuous changes in uncertain system dynamics. 

Embodiments of the present invention can also employ a 
derivative-free adaptive control law. The adaptive control law 
can differ from the laws conventionally employed in adaptive 
control in that it does not make use of integration to generate 
the weight update law. This is advantageous in avoiding con- 
flicts, such as tracking errors, that may arise when the adap- 
tive control law is used to augment a non-adaptive controller 
which itself has integral action. 

In some embodiments, controllers of the present invention 
can avoid the use of high gains in both the observer design and 
the derivative-free weight update law. This is desirable 
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because high gains can, for example, amplify sensor noise 
and increase the potential for unstable responses due to 
unmodeled high frequency dynamics. In some embodiments, 
controllers of the present invention also afford significant 
5 freedom in the selection of basis functions used to parameter- 
ize the uncertainty within the plant dynamics. Additionally, 
embodiments of the present invention avoid integration of an 
error signal in the implementation of the adaptive control law. 
This can help avoid, for example, slowly varying tracking 
to errors. 

Embodiments of the present invention can comprise an 
adaptive control system for controlling a vehicle. In some 
embodiments, the adaptive control system can comprise a 
state observer that can be configured to receive a sensed 
15 quantity from the vehicle. The state observer can be further 
configured to output a state estimate based at least in part on 
the sensed quantify. 

In some embodiments, the adaptive control system can also 
comprise a controller configured to receive the state estimate 
20 and employ the state estimate in a derivative-free adaptive 
control law to calculate an adaptive control. The derivative- 
free adaptive control law can be based at least in part on a 
derivative- free weight update law. The derivative-free weight 
update law can comprises a time-varying estimate of an ideal 
25 vector of weights. In some embodiments, the controller can 
further be configured to produce a control command that can 
be an input to a control system of the vehicle. A component of 
the control command can be the adaptive control. 

In some embodiments, the derivative-free weight update 
30 law can comprise a first gain, and the first gain can provide a 
parameter dependent Riccati equation with a positive definite 
solution. In some embodiments, a parameter other than the 
first gain of the parameter dependent Riccati equation can 
restrict the values of the first gain for which the parameter 
35 dependent Riccati equation can have a position definite solu- 
tion. 

In some embodiments, the control command can further 
comprise a nominal control from the existing control system 
of the vehicle. The nominal control can comprise a first gain. 
40 The adaptive control can be added to the nominal control, 
and, in some embodiments, the first gain of the nominal 
control is not modified by the adaptive control. In some 
embodiments, the nominal control can comprise a first gain 
and a second gain, and either the first gain, the second gain, or 
45 both can be employed by the state observer. In some embodi- 
ments, the adaptive control can comprise a weight estimate 
and a basis function. The weight estimate can be obtained 
from the derivative- free weight update law. 

Embodiments of the present invention can comprise a 
50 method for adaptive control of an uncertain system. The 
method can comprise providing a first control command as an 
input to the uncertain system, and the first control command 
can comprise a first adaptive control. The method can further 
comprise receiving at least one sensed quantify from the 
55 uncertain system by a state observer, and outputting a state 
estimate from the state observer. The method can further 
comprise employing the state estimate in a derivative-free 
adaptive control law to calculate a second adaptive control. 
The derivative-free adaptive control law can comprise a 
60 derivative-free weight update law. The derivative-free weight 
update law can comprises a time-varying estimate of an ideal 
vector of weights. In some embodiments, the method can 
further comprise providing a second control command as an 
input to the uncertain system. The second control command 
65 can comprise the second adaptive control. 

In some embodiments, the derivative-free weight update 
law can comprise a first gain, and the first gain can provide a 
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parameter dependent Riccati equation with a positive definite 
solution. In some embodiments, a parameter other than the 
first gain of the parameter dependent Riccati equation can 
restrict the values of the first gain for which the parameter 
dependent Riccati equation can have a position definite solu- 
tion. In some embodiments, a weight estimate and a basis 
function can be multiplied together to yield the second adap- 
tive control. The weight estimate can be obtained from the 
derivative-free weight update law. In some embodiments, the 
weight estimate can be a function of continuous time. In other 
embodiments, the weight estimate can be a function of dis- 
crete time. 

In some embodiments, the second control command can 
comprise the second adaptive control added to a nominal 
control. The nominal control can comprise a gain, and, in 
some embodiments, the gain is not modified by the adaptive 
control. In some embodiments, the uncertain system can be a 
non-minimum phase system. 

Embodiments of the present invention can further com- 
prise a state control system for controlling a vehicle. The state 
control system can comprise a reference model configured to 
output a state estimate. The state control system can further 
comprise a controller configured to receive the state estimate 
and employ the state estimate in a derivative-free adaptive 
control law to calculate an adaptive control. The derivative- 
free adaptive control law can be based at least in part on a 
derivative-free weight update law. The derivative-free weigjit 
update law can comprises a time- varying estimate of an ideal 
vector of weights. In some embodiments, the controller can 
further be configured to produce a control command that can 
be an input to a control system of the vehicle. A component of 
the control command can be the adaptive control. 

In some embodiments, the derivative-free weight update 
law further comprises a first gain, and the first gain can pro- 
vide a parameter dependent Riccati equation with a positive 
definite solution. In some embodiments, a parameter other 
than the first gain of the parameter dependent Riccati equation 
can restrict the values of the first gain for which the parameter 
dependent Riccati equation has a position definite solution. 

In some embodiments, the control command can further 
comprise a nominal control from the control system of the 
vehicle. The nominal control can comprise a first gain. The 
adaptive control can be added to the nominal control, and, in 
some embodiments, the first gain of the nominal control is not 
modified by the adaptive control. In some embodiments, the 
adaptive control comprises a weight estimate and a basis 
function. The weight estimate can be obtained from the 
derivative-free weight update law. 

These and other objects, features and advantages of the 
present invention will become more apparent upon reading 
the following specification in conjunction with the accompa- 
nying drawing figures. 

BRIEF DESCRIPTION OF THE FIGURES 

FIG. 1 is a schematic of an adaptive control system, in 
accordance with some embodiments of the present invention. 

FIG. 2 depicts graphs showing nominal and adaptive con- 
trol responses for an adaptive control design that assumes 
constant ideal weights, in accordance with some embodi- 
ments of the present invention. 

FIG. 3 depicts graphs showing nominal and adaptive con- 
trol responses for an adaptive control design that assumes 
time-varying ideal weights, in accordance with some embodi- 
ments of the present invention. 
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FIG. 4 depicts graphs showing disturbance and sensor 
noise, in accordance with some embodiments of the present 
invention. 

FIG. 5 depicts graphs showing nominal and adaptive con- 
5 trol responses with disturbance and sensor noise for an adap- 
tive control design that assumes time- varying ideal weights, 
in accordance with some embodiments of the present inven- 
tion. 

10 DETAILED DESCRIPTION 

Embodiments of the present invention can comprise an 
adaptive control system for controlling an uncertain system. 
More specifically, embodiments of the present invention can 
comprise an output feedback or state feedback adaptive con- 
trol architecture for continuous time and uncertain dynamic 
systems. In some embodiments, the controller can employ 
derivative-free adaptive control architectures, such as, for 
2 Q example, derivative-free weight update laws. The controller 
can further employ one or more time-varying weight update 
laws. The time-varying weight update laws can be a function 
of a weight estimate which, in mm, can be a function of 
continuous time or discrete time. 

25 Embodiments of the present invention can control both 
minimiun phase and non-minimum phase systems. In some 
embodiments, the present invention can augment an existing, 
non-adaptive control design without modifying the gains 
employed in that design. Embodiments of the present inven- 
30 tion can employ a derivative-free weight update law that is 
well-suited, for example, for adaptation to time- varying sys- 
tems. The derivative-free weight update law is also well- 
suited for adaptation to discontinuous changes in uncertain 
system dynamics. In some embodiments, controllers of the 
35 present invention can avoid the use of high gains in both the 
observer design and the derivative-free weight update law. In 
some embodiments, controllers of the present invention can 
also afford significant freedom in the selection of basis func- 
tions used to parameterize the uncertainty within the plant 
40 dynamics. Embodiments of the present invention can also 
avoid integration of an error signal in the implementation of 
the adaptive control law. 

To simplify and clarify explanation, the system is some- 
times described below as an adaptive control system and/or 
45 method for controlling an aircraft. One skilled in the art will 
recognize, however, that the invention is not so limited. The 
system can also be deployed for other control-related appli- 
cations, such as, for example and not limitation, controlling 
an automobile engine or combustion process. 

50 The materials described hereinafter as making up the vari- 
ous elements of the present invention are intended to be 
illustrative and not restrictive. Many suitable materials that 
would perform the same or a similar function as the materials 
described herein are intended to be embraced within the 
55 scope of the invention. Such other materials not described 
herein can include, but are not limited to, materials that are 
developed after the time of the development of the invention, 
for example. Any dimensions listed in the various drawings 
are for illustrative purposes only and are not intended to be 
60 limiting. Other dimensions and proportions are contemplated 
and intended to be included within the scope of the invention. 

As mentioned above, a problem with existing adaptive 
controllers is that they assume constant ideal weights. 
Embodiments of the present invention, however, can avoid 
65 reliance on this assumption. Instead, embodiments of the 
present invention can employ a derivative-free weight update 
law with a time- varying ideal vector of weights. 
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Embodiments of the present invention can also employ a 
parameter dependent Riccati equation in the stability analysis 
to avoid high gain approaches. Aspects of this analysis are 
detailed in T. Yucelen, K. Kim, & A. J. Calise, “Derivative- 
Free Output Feedback Adaptive Control,” AlAA Guidance, 5 
Navigation, and Control Conference, Portland, Oreg. (201 1), 
which is hereby incorporated by reference in its entirety as if 
fully set forth herein. Employing a parameter dependent Ric- 
cati equation in this manner renders embodiments of the 
present invention able to adaptively control minimum phase 
and non-minimum phase systems. This is due, at least in part, 
to the system’s ability to avoid high gains. Moreover, embodi- 
ments of the present invention represent an extension of the 
state feedback derivative-free adaptive control law developed 
in T. Yucelen & A. J. Calise, “Derivative-Free Model Refer- 
ence Adaptive Control,” Journal of Guidance, Control, 
and Dynamics, vol. 34, No. 4, pp 933-950 (2011), which is 
also hereby incorporated by reference in its entirety as if fully 
set forth herein. 

FIG. 1 illustrates a preferred embodiment of an adaptive 
control system of the present invention. As shown in FIG. 1, 
an input to the uncertain system can be a vector control 
command, u(t). In an aircraft, components of u(t) can repre- 
sent the control surface deflections, e.g., elevator, aileron, and 
rudder deflections. In some embodiments, u(t) can represent 
the signals sent to the electrical or hydraulic actuators that 
move the control surfaces. As shown in Equation 1 below, u(t) 
can be the sum of two vector components: 

30 

u{t)=u^{t)+u^^{t) Equation 1: 

The first vector component of Equation 1 , u„(t), can be the 
“nominal control.” The nominal control can be a portion of an 
input produced by an existing, non-adaptive control law. In 
some embodiments, the existing, non-adaptive control law 35 
can be produced by an existing on-board control system. This 
control law can be made up of a feedback gain Kj, a feedfor- 
ward gain Kj, and a state observer output. The methods used 
for designing the feedback and feedforward gains, as well as 
the state observer output, are well known in the art to engi- 40 
neers and designers who practice in the areas of non-adaptive 
feedback control systems and feedback form for multiple- 
input, multiple-output systems. These methods apply equally 
well to minimum phase and non-minimum phase systems, but 
are dependent on the model employed to represent the 45 
dynamics of the system being controlled. Their performance 
can therefore degrade if modeling uncertainty is present. 

The second vector component of Equation 1 , u^^t), can be 
the “adaptive control.” In some embodiments, as shown in 
Equation 1 , the adaptive control can be added to the nominal 50 
control. The adaptive control can therefore augment the 
nominal control. The adaptive control can be produced by a 
derivative-free adaptive control law and a derivative-free 
weight update law. As discussed below and shown in FIG. 1, 
the form of the derivative-free adaptive control law and the 55 
methods employed to select the gains, Qj and (in the 
equation for Q 2 ( 9 ): the time delay parameter, x, are 

objects of the present invention. 

In FIG. 1, y(t) can represent the regulated output, and y(t) 
can represent its estimate. The difference between y(t) and 60 
y(t) can be the error signal, y(t), which can be employed in the 
laws described below. If the uncertainty in the system is small, 
y(t) can be small, and the adaptive control can remain close 
the zero. 

In some embodiments, equations that describe an uncertain 65 
system, as shown in FIG. 1, are assumed to have the form of 
Equations 2a-2c: 


x{t)=Ax{t)-¥B [u{t)+/^{t,x{t))] Equation 2a: 

^ 5 (?)=C^(?) Equation 2b : 

y{i)=Cx{i) Equation 2c: 

In some embodiments, A(t,x(t)) can represent the uncer- 
tainty contained in the system dynamics. This uncertainty can 
be matched to the control, u(t), so that both the control and the 
uncertainty can enter the plant dynamics in the same manner, 
i.e., through input matrix B. It can also be assumed that the 
other plant parameter matrices, such as, for example and not 
limitation. A, C^, and C, are known and can be used in the 
design of the nominal control. 

In some embodiments, the signal y^(t) can represent the 
vector of sensed quantities from the uncertain system that are 
available for feedback. In some embodiments, the signal y(t) 
can be a subset of the elements in y^(t) that can be regulated in 
such a manner that y(t) closely follows a command vector, 
r(t). FIG. 1 shows the manner in which the command vector 
can enter the control system. 

In some embodiments, the state observer can be imple- 
mented based on the differential equation labeled Equation 3 
below. In Equation 3, the particular design of the observer can 
be defined by the observer gain matrix, L. 

x{t)=Ax{t)+Bu„(t)+L[y,(t)-C,x(t)] Equation 3: 

In some embodiments, it can be assumed that the uncer- 
tainty in Equations 2a-2c can be linearly parameterized in the 
sense that the uncertainty can be represented by Equation 4: 

tS(t,x)=W^(t)P(x),\^(x)\<^ Equation 4: 

Equation 4 can be assumed to hold for all values of the state 
vector, X, within a sufficiently large, but bounded domain of 
the state space in wliich the state, x(t), of the system evolves. 
In some embodiments, W(t) can represent an ideal but 
unknown vector of weights that can be bounded functions of 
time. Moreover, |3(x) can be a known and bounded vector of 
one or more basis functions to be selected by a designer. Since 
P(x) can be chosen by a designer, |3(x) can have a computable 
Euclidian vector norm bound, ]J. 

Commonly, in adaptive control, it is necessary to assume 
that the ideal vector of weights is constant. In embodiments of 
the present invention, however, the ideal vector of weights in 
Equation 4. W(t). can be time-varying, and therefore does not 
need to be constant. The time-varying vector provides more 
freedom in the selection of basis functions than a constant 
vector. In addition, for a given set of basis functions, a time- 
varying vector provides additional types of uncertainties that 
can be accurately represented, including uncertainties that are 
time- varying and/or discontinuous with time. A time- varying 
vector of weights can also react to sudden changes in system 
dynamics, such as, for example and not limitation, those 
caused by deployment of a payload, structural damage, and 
reconfiguration such as variable wing sweep of an aircraft. 

In some embodiments, the purpose of the adaptive control, 
u^^t), can be to cancel any uncertainty in the system. Since 
both W(t) and x(t) can be unknown, however, it can be nec- 
essary to employ an estimate for these quantities. Equation 5 
represents a derivative- free adaptive control law that can esti- 
mate W(t) and x(t): 

u^{t)= ^(r)p(,;c(^)) Equation 5 : 

In some embodiments, as shown in FIG. 1, the state esti- 
mate, x(t), can be obtained from Equation 3, i.e., as an output 
of the state observer. The weight estimate, W(t), can be 
obtained from a derivative-free weight update law as shown in 
Equations 6a-6b: 
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Q 2 (f)^ 2 ?>(Af)^(f)) Equation 6a: 

I^(t)=Q^I^(t-r)+Q 2 (t) Equation 6b: 

In Equation 6b, W(t-x) can be a time-varying estimate of 
the ideal vector of weights. Moreover, t can be a scalar, 5 
positive value that the designer can choose. 

In some embodiments. Equations 6a-6b can define the 
manner in which W(t) is propagated in continuous time. 
Many controllers, however, are implemented in discrete time, 
denoted by t,. In some embodiments, the time delay parameter to 
for a discrete time system can be an integer multiple, n, of the 
time interval dt=t,.-t,._j. Propagating W(t,.) in discrete time can 
therefore be achieved by a derivative-free weight update law 
as shown in Equations 7a-7b: 

15 

Q 2 (ti)=K 2 li(x(tj)y^(ti) Equation 7a: 

W(tj)=Qi+Q 2 (tj)W(tj-n*dt) Equation 7b: 

In Equation 7b, W (t,-n*dt) can be a time- varying estimate 
of the ideal vector of weights. Thus, Equations 6b and 7b do 20 
not assume constant ideal weights. 

In some embodiments, a derivative-free adaptive control 
law, such as Equation 5, for example, and a derivative-free 
weight update law, such as Equations 6a-6b or 7a-7b, for 
example, can be referred to together as a derivative- free adap- 25 
tion law. FIG. 1 depicts a derivative-free adaption law. 

In some embodiments, it can be desirable to ensure that the 
adaptive law of Equations 6a-6b produces a response in 
which the state of the system remains bounded. It can also be 
desirable to ensure that the tracking error, y(t), is uniformly 3Q 
ultimately bounded to a sufficiently small error norm. With 
respect to Equations 7a-7b, it can also be desirable to ensure 
that the tracking error, y(t), is uniformly ultimately bounded 
to a sufficiently small error norm for sufficiently small sample 
time intervals, dt. These goals can be accomplished in 35 
embodiments where the design parameters in Equations 
6a-6b and/or Equations 7a-7b satisfy Equations 8a-8b: 

Qi^Qi<Ki/,Ki<l/(l+|i),ji>0 Equation 7b: 


K2>0 Equation 8b: 40 

Values for and K2 can be obtained by the parameter 
dependent Riccati equation labeled Equation 9: 

0=A^^P+PA^+Q^+(k2+1/\i)NN^ Equation 9: 

45 

where: 


N=C^-PB 

Equation 9 can have a positive definite solution for P. In 
some embodiments, in Equation 9, the matrix Q„>0 can be 50 
freely chosen so long as it is positive definite. In some 
embodiments, A^=A-LC^, where L is the state observer gain 
matrix from Equation 3 and can be known from the existing 
controller design. In addition, K2 can be the gain from Equa- 
tion 8b, which can be determined as a part of the design 55 
process. K2 can have an upper limit determined by the condi- 
tion that the solution for P in Equation 9 must remain positive 
definite, p can be a positive value as described in Equation 8a, 
and, in some embodiments, can have an upper bound, p can be 
chosen by the designer, and, in some embodiments, can be the 60 
“parameter” referred to in the term “parameter dependent 
Riccati equation,” i.e.. Equation 9 . 

In some embodiments, a condition that P>0 can be associ- 
ated with the parameter dependent Riccati equation. This 
condition can impose a restriction on how the gains, Qj and 65 
K2, which can be employed in Equations 6a-6b and Equations 
7a-7b, may be chosen. This is because, for example, for any 
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positive value of p, the value of Kj is bounded by l/(l+p). 
Equation 8a, in turn, can limit how large the matrix can be. 

Similarly, if v=K2-tl/p, Equation 8a can impose an upper 
bound for v, which can be v, such that P>0. Accordingly, 
Equation 9 can possess a positive definite solution for P for 
0<v<v. Thus, for any positive value of p, there can be an upper 
bound for K2 determined by v. 

Embodiments of the present invention can further com- 
prise a method for adaptive control of an uncertain system. As 
shown in FIG. 1, the method can comprise providing a control 
command, u(t), to the uncertain system, causing the uncertain 
system to react. The control command can comprise a nomi- 
nal control, u„(t), and an adaptive control, u^^(t). The method 
can further comprise the state observer receiving a sensed 
quantity, y^t), from the uncertain system. The state observer 
can then output a state estimate, x(t). The controller can then 
employ the state estimate in a derivative-free adaptive control 
law to calculate a new adaptive control. The derivative-free 
adaptive control law can comprise a derivative-free weight 
update law. As discussed above, the derivative-free weight 
update law can comprise a time-varying ideal vector of 
weights, and does not assume constant ideal weights. 

In some embodiments, the method can further comprise 
providing a new control command to the uncertain system. 
The new control command can comprise a new nominal con- 
trol and a new adaptive control. The new adaptive control can 
be determined by the derivative-free adaptive control law, as 
discussed above. 

In some embodiments, a special case can arise when, in 
Equation 2b, y,,(t)=x(t) or C^=I. These embodiments can cor- 
respond to cases of state feedback. In some embodiments, the 
state observer depicted in FIG. 1 may or may not be a part of 
the existing control system, depending, for example and not 
limitation, on the level of sensor noise that is present in the 
system. When the state observer is part of the existing control 
system, the controller and control system can function, for 
example, as described above. In some embodiments, where 
the state observer is not a part of the existing control system, 
however, the state observer depicted in FIG. 1 can be 
replaced, for example, with a reference model. The equation 
that defines the reference model can be the same as Equation 
3, but, in some embodiments, L=0. In addition, in some 
embodiments, A^=A in Equation 8. The remainder of the 
controller and methods of control can function as described 
above. 


Example 

The derivative-free weight update law of Equations 7a-7b 
can be illustrated using a model of wing rock dynamics. Wing 
rock can be a nonlinear phenomenon in which an aircraft 
exhibits oscillations in roll at high angles of attack. A two- 
state model for wing rock dynamics can be written in the form 
given by Equations 10a- 10b below, where w(t) represents 
sensor noise: 


*2(0 


0 nrj:i(r) 

0 0 X2(t) 


[01 

+ J [«(0 + A(r-hr))] 


Equation 10a 


yhO = [1 


2:1(0 

2:2(0 


+ iv(t) 


Equation 10b 


Modeling uncertainty of the control system can be repre- 
sented by Equation 1 1 : 
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A(t^(0)=[«l+/lW]*l(')+[«2+/2(0teW+«3l^lWI*2W+ 

a 4 \x 2 {t)\x 2 (t)+a^i^(t)+d(t) Equation 11: 

Equation 11 can have constant coefficients aj=0.23, 
02=0.69, a3=-0.62, 04 = 0 . 01 , and Oj=0.02, time-varying 
coefficients fi(t), f 2 (t), and external disturbance d(t). In Equa- ^ 
tion 10b, Xj(t) can represent the roll angle, and X 2 (t) can 
represent the roll rate. The existing controller gains can be 
Ki=[2.56 2.56] and K2=2.56. The existing state observer gain 
can be L^=[12.8 64.0]. The adaptive control design can use 
sigmoidal basis ffinctions of the form p^(x)=[0.5 Pi(Xi) 
P 2 (x 2 )], where 


i=l, 2. Since ip,(x)l<l, it can follow that P=1.5. For |r=0.05 
and Q„=0.25l2, it can be determined that v=124.6. This 
implies that, for this example, the adaptation gain in Equa- 20 
tions 7a-7b must satisfy K2<35.4. Thus, in order to satisfy the 
conditions in Equations 8a-8b and 9, and therefore ensure a 
stable response, Qi=0.95l3, K2=35, and x=0.01 seconds can 
be chosen for the derivative-free weight update law in Equa- 
tions 7a-7b. 25 

In this example, a command tracking problem is consid- 
ered. The initial conditions for the dynamics in Equations 
lOa-lOb are set to zero. FIG. 2 compares the nominal (adap- 
tation off) and the adaptive control (adaptation on) responses 
for the case when the ideal weights are constant (fi(t)= 30 
f 2 (t)= 0 ), and in the absence of disturbances and sensor noise 
(d(t)=w(t)=0). As can be seen in FIG. 2, overall performance 
is significantly improved with adaptation on. This improve- 
ment is measured by comparing how well the responses fol- 
low a reference model response, y„(t), that corresponds to the 35 
situation in which the uncertainty, A(t,x(t)), is zero. 

FIG. 3 compares the responses for a case when the ideal 
weights are time- varying. fi(t) is a square wave having an 
amplitude of 0.5 and a period of 1 5 seconds and f 2 (t) is a sign 
wave defined by f2(t)=0.5 sin(l .5t). As can be seen by com- 40 
paring FIGS. 2 and 3, the improvement with adaptation on is 
greater in FIG. 3 than it is in FIG. 2. This is because, in FIG. 

3, the ideal weights are permitted to be time- varying. In 
addition, the effect of fi(t), which is discontinuous in time, is 
clearly evident in the nominal case because the response does 45 
not accurately track the model response. 

FIG. 4 depicts the disturbance, d(t), and measurement 
noise, w(t). In this case, d(t) is a square wave having an 
amplitude of 0.1 and a period of 6 seconds. To model sensor 
noise, w(t) can be a band limited white noise process with a 50 
correlation time constant of 0.01 seconds, and a noise power 
level of 0.0001. 

FIG. 5 shows that, even when disturbance and sensor noise 
is incorporated, tracking performance is significantly 
improved with adaptation on, and that the control time history 55 
is well behaved, i.e., sensor noise is not amplified. FIG. 5 
includes a comparison between A(t,x(t)) and u^^t), which 
shows that u^J^t) nearly cancels A(t,x(t)). 

While several possible embodiments are disclosed above 
and throughout this specification, embodiments of the present 60 
invention are not so limited. For instance, while several pos- 
sible control systems and derivative-free weight adaption 
laws have been provided, other suitable methods, configura- 
tions, or combinations could be selected without departing 
from the spirit of embodiments of the invention. In addition, 65 
the configuration used for various features of embodiments of 
the present invention can be varied according to the particular 
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requirements of a plant or control system. Such changes are 
intended to be embraced within the scope of the invention. 

The specific methods, method steps, systems, and other 
embodiments disclosed can be varied according to particular 
needs. Such changes are intended to be embraced within the 
scope of the invention. The presently disclosed embodiments, 
therefore, are considered in all respects to be illustrative and 
not restrictive. The scope of the invention is indicated by the 
appended claims, rather than the foregoing description, and 
all changes that come within the meaning and range of 
equivalents thereof are intended to be embraced therein. 

What is claimed is: 

1 . An adaptive control system for controlling a vehicle, the 
adaptive control system comprising: 

a state observer configured to receive a sensed quantity 
from the vehicle, the state observer further configured to 
output a state estimate based at least in part on the sensed 
quantity; and 

a controller configured to receive the state estimate and to 
employ the state estimate in a derivative-free adaptive 
control law to calculate an adaptive control, the deriva- 
tive-free adaptive control law based at least in part on a 
derivative-free weight update law, the controller further 
configured to output a control command that is an input 
to a control system of the vehicle for stabilizing or con- 
trolling the vehicle; 

wherein at least a component of the control command is the 
adaptive control; and 

wherein the derivative-free weight update law comprises 
the state estimate, a tracking error, a basis function, and 
a time-varying estimate of an ideal vector of weights. 

2. The adaptive control system of claim 1, wherein the 
derivative-free weight update law further comprises a first 
gain, the first gain providing a parameter dependent Riccati 
equation with a positive definite solution. 

3. The adaptive control system of claim 2, wherein a 
parameter other than the first gain of the parameter dependent 
Riccati equation restricts the values of the first gain for which 
the parameter dependent Riccati equation has a position defi- 
nite solution. 

4. The adaptive control system of claim 1, 

wherein the control command further comprises a nominal 
control from the control system of the vehicle, the nomi- 
nal control comprising a first gain; 

wherein the adaptive control is added to the nominal con- 
trol; and 

wherein the first gain of the nominal control is not modified 
by the adaptive control. 

5. The adaptive control system of claim 4, wherein the 
nominal control comprises a first gain and a second gain, and 
either the first gain, the second gain, or both are employed by 
the state observer. 

6. The adaptive control system of claim 1, wherein the 
adaptive control comprises a weight estimate and a basis 
lunction; and 

wherein the weight estimate is obtained from the deriva- 
tive-free weight update law. 

7. A method for adaptive control of an uncertain system 
associated with a vehicle, the method comprising: 

providing, by a controller associated with the uncertain 
system, a first control command as an input to the uncer- 
tain system, the first control command comprising a first 
adaptive control; 

receiving, by a state observer, at least one sensed quantity 
from the uncertain system; 

outputting, by the state observer and responsive to the at 
least one sensed quantity, a state estimate; 
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employing, by the controller, the state estimate in a deriva- 
tive-free adaptive control law to calculate a second adap- 
tive control, the derivative-free adaptive control law 
comprising a derivative-free weight update law; and 

outputting, by the controller, a second control command as 
an input to the uncertain system for stabilizing or con- 
trolling the uncertain system, the second control com- 
mand comprising the second adaptive control; 

wherein the derivative-free weight update law comprises 
the state estimate, a tracking error, a basis function, and 
a time- varying estimate of an ideal vector of weights. 

8. The method for adaptive control of claim 7, wherein the 
derivative-free weight update law further comprises a first 
gain, the first gain selected to provide a parameter dependent 
Riccati equation with a positive definite solution. 

9. The method for adaptive control of claim 8, wherein a 
parameter of the parameter dependent Riccati equation 
restricts the values of the first gain for wliich the parameter 
dependent Riccati equation has a positive definite solution. 

10. The method for adaptive control of claim 7, wherein a 
weight estimate and a basis function are multiplied together 
to yield the second adaptive control, the weight estimate 
obtained from the derivative-free weight update law. 

11. The method for adaptive control of claim 10, wherein 
the weight estimate is a function of continuous time. 

12. The method for adaptive control of claim 10, wherein 
the weight estimate is a function of discrete time. 

13 . The method for adaptive control of claim 7, wherein the 
second control command comprises the second adaptive con- 
trol added to a nominal control. 

14. The method for adaptive control of claim 13, wherein 
the nominal control comprises a gain, and the gain is not 
modified by the adaptive control. 

15. The method for adaptive control of claim 7, wherein the 
uncertain system is a non-minimum phase system. 

16. An adaptive control system for controlling a vehicle, 
the adaptive control system comprising: 
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a reference model configured to output a state estimate; and 

a controller configured to receive the state estimate and 
employ the state estimate in a derivative-free adaptive 
control law to calculate an adaptive control, the deriva- 
tive-free adaptive control law based at least in part on a 
derivative-free weight update law, the controller further 
configured to produce and output a control command 
that is an input to a control system of the vehicle for 
stabilizing or controlling the vehicle; 

wherein at least a component of the control command is the 
adaptive control; and 

wherein the derivative-free weight update law comprises 
the state estimate, a tracking error, a basis function, and 
a time- varying estimate of an ideal vector of weights. 

17. The adaptive control system of claim 16, wherein the 
derivative-free weight update law further comprises a first 
gain, the first gain providing a parameter dependent Riccati 
equation with a positive definite solution. 

18. The adaptive control system of claim 17, wherein a 
parameter other than the first gain of the parameter dependent 
Riccati equation restricts the values of the first gain for which 
the parameter dependent Riccati equation has a position defi- 
nite solution. 

19. The adaptive control system of claim 16, 

wherein the control command further comprises a nominal 
control from the control system of the vehicle, the nomi- 
nal control comprising a first gain; 

wherein the adaptive control is added to the nominal con- 
trol; and 

wherein the first gain of the nominal control i s not modified 
by the adaptive control. 

20. The adaptive control system of claim 16, wherein the 
adaptive control comprises a weight estimate and a basis 
function, the weight estimate obtained from the derivative- 
free weight update law. 





